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ABSTRACT: 

The use of Pontryagin T s Maximum Principle in analyses of deterministic 
inventory models requires less restrictive assumptions about the nature of 
order policies than can be allowed when only the differential calculus is 
used. Two analyses are presented to illustrate this fact. The first in- 
volves a periodic review model with no shortages allowed. The production 
and holding cost functions were kept as general as possible. The second 
analysis involves a periodic review model with shortages allowed and linear 
production and inventory costs. As would be expected, the optimal order 
policies obtained are more general than those obtained in the past. 
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I. INTRODUCTION 



This paper is devoted to deterministic inventory models for three 
primary reasons. The first is that such models provide considerable insight 
about inventory models which may not be deterministic. The second is that 
many stochastic models are approximated by deterministic ones (for example, 
by using expected demand rates in place of deterministic ones). The third is 
the limited variety of deterministic models which have been studied in the 
literature. The first two reasons are of particular importance to people 
who are applying inventory theory to real-world inventory systems. 

Past work [3] on deterministic inventory models, with few exceptions, 
has. assumed the nature of the ordering policy to withh one or two unknown 
parameters. For example, a periodic review model might specify that a 
quantity Q can only be ordered at the end of a known period of time T. 

The unusual problem would be to determine the value of the parameter Q which 
minimizes the total purchase or production plus holding costs. If, however,, 
the nature of the optimal policy need not be specified prior to the analysis 
then we would expect that the complete nature of the optimal policy will result. 

Unfortunately, if the nature of the ordering policy is not specified 
then considerable complexity of analysis can result if one attempts to use the 
differential calculus (see, for example, the work of Arrow and Karlin [2]). 

This complexity can be reduced however if the Maximum Principle of Pontryagin 
et al [4] is used in determining the optimal ordering policy. Such an approach 
will be taken in this paper. 

The paper begins with an analysis of the no-stockout periodic review 
problem posed by Arrow and Karlin [2] to illustrate the approach and the 
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simplicity of analysis that it provides. Then an analysis of a periodic review 
problem with stockouts allowed is made to show how the allowing of stockouts 
complicates the optimal control problem. 

II. NO-STOCKOUTS PROBLEM 



Model Formulation — This is a generalization of the problem formulated by 
Arrow and Karlin [2] . We are interested in scheduling the production of an 
item so as to minimize its production plus holding costs over a specified 
period of time T. We will assume a zero lead time. Let 
I(t) = the inventory level at time t; 
r(t) = demand rate at time t; 
u(t) = the production rate at time t. 

Both r(t) and u(t) are to be non-negative. 

All demands are assumed to be met and, as a consequence, 



I(t) = KO) + 



ft 

Jo 



[u(t) 



r (t) ] di ^ 0 



( 1 ) 



where 1(0) represents the on-hand inventory at the beginning of the time period. 
We can rewrite (1) as 



ft 

u(i)di ^ 

Jo 



ft 

r (t )dx - 1(0) 

Jo 



( 2 ) 



and consider it to represent a constraint on u(t). 

The production and holding costs per unit time will be represented by 
c(u(t)) and h(I(t)) respectively. We will assume that they are monotone- 
increasing and continuously differentiable in their respective arguments. No 
other costs are assumed to exist. The total production plus holding costs 
for the period are given by (3) . 



J(u) 



f T 

[ c (u ( t ) ) + h (I (t ) ) ] d t 

Jo 



(3) 
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Our objective is to find a policy u(t) ^ 0 which satisfies (2) 



and minimizes (3). 



The Maximum Principle for the Problem — For convenience, we will refer to (3) 
in the following form in our analysis: 



J (u) 



T 

f 0 (u,I)dt . 



In applying the Maximum Principle a function called the Hamiltonian 
is created as follows: 



H(u, I,Pq,p 1 , t) = p 0 (t)f Q (u,I) + p^t) 



(A) 



The derivative ^ is obtained by differentiating (1). The Hamiltonian, upon 

introducing the expressions for f^ and , is given by (5) where t has 

been suppressed. 



HCujIjPq^) = Pq[c (u)+h(I) ] + p 1 [u-r] 



(5) 



For fixed I, p^, and p^ let M(I,Pq,p^) « max H(u,I,Pq,p^) over the domain 

of u(t) values satisfying u(t) ^ 0 and I(t) ^ 0 

The necessary conditions for optimality of our problem from the 
Maximum Principle are given by the following theorem [A] . 

Theorem : An admissible order policy u*(t) and the resulting inventory level 

I*(t) are optimal if there exist continuous functions Pq( 0 and p^(t) 



which satisfy 



dl 3 H 
dt 3 ?1 ’ 


(6) 




dt = ° 5 


(7) 
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dp l dH 



dt dl 



( 8 ) 



P 0 (T) = - 1 
Pl (T) = 0 



( 10 ) 



(9) 



such that 



H(u*,I*,p 0 ,p 1 ) = M(I*,p 0> p 1 ) 



for all t in [0,T] . 



The condition given by (10) is a consequence of the transversality 



condition for a free right-hand end condition for l(t) ; that is, we are not 
going to force I(T) to take on any specified value. This is a point of major 
difference between this analysis and that of Arrow and Karlin[2] and Adiri and 
Ben-Israel [1]. In both of these studies the assumption was made that I*(T) = 0. 
If, however, I(T) =0 is really optimal then the results of the analysis should 
show it. We shall see below that they do. 

The Optimal Policy — Examining the conditions from the theorem we get back from 
(6) our constraint that ~~ = u(t) - r(t) and consequently that 

rt 



with 1(0) as the given initial condition. From (7) and (9) we get Pq( 0 = 
for all t in [ 0 , T ] . From (8) we get 



I(t) = 1(0) + [u (x)-r ( t) ] dr 

4 

0 



dt = p 0 dl 



dp l _ d h(I) 



and, because p^Ct) = _ 1> 




d h(I) 
dt 



dt 
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Solving for p 1 (t ) , 



p 1 (t) = 



d h(I) 
dl 



dx + Pj^ ( 0 ) 



(ID 



Because of (10) p^(T) =0 is needed and it follows that 



Pl (0) = - 



d h(I) 
dl 



dx 



and, therefore , ( 11 ) reduces to 



P 1 (t) = ~ 



d h (I) 
dl 



dx 



( 12 ) 



We will find 4^- helpful in selecting u*(t) 
du 



From ( 5 ) we obtain 



dH 



du ^0 du 



d c (u) 



+ Pi 



(13) 



Substitution of p^(t) = “1 and p^(t) as given by (12) into (13) then results 



in 



dH 

du 



d c (u) 
du 



d h (I) 

dl 



dx 



(14) 



Because we assumed > 0 and >0 it is immediately evident from (14) 

du dl 

that 4^ < 0 for t in [0,T] and therefore that the maximum value of H 

du 

occurs for the smallest value of u(t) which satisfies u(t) ^ 0 and I(t) ^ 0 
Therefore, we deduce that 



u*(t) = 



0 for 0 £ t < t^ ; 
r(t) for t x £ t £ T , 



(15) 



where t^ is obtained ( 1 ) when I(t^) = that is, from 



r(x)dx = 1 ( 0 ) 
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In other words, the optimal order policy is to first use up the on-hand inventory, 
then order to just meet current demand. We see that no inventory is held after 
the initial inventory 1(0) is consumed. It is therefore immediately evident 
that I (T) = 0 under this policy. 



Comments — The optimal policy is intuitively appealing. When there are costs assoc- 
iated with both production and holding inventory we would like to avoid incurring 
either if we can. The constraints require, however, that we meet demand when it 
occurs. Waiting to produce until we have used up the existing inventory 1(0) 
keeps inventory holding costs to a minimum because we reduce the inventory as 
fast as possible while incurring no production costs. Producing only to meet 
demand after the inventory 1(0) is used up insures that I(t) is zero and 
therefore that no holding costs are incurred. The production costs incurred are 
only those necessary to meet the demand. The only restrictions we placed on 
c(u) and h(I) were that 



dc (u) 
du 


> 0 


for 


u ^ 0 , 


dh(I) 

dl 


> 0 


for 


1^0 . 



We could also allow ^ 0 and get the same result. 



For example, if there 



is no holding cost for items in storage we would get (14) in the reduced form 



dH = _ dc 
du du 

and the optimal policy given by (15) still holds. Our result is much more 
general than that of Arrow and Karlin [2] who required c (u) to be convex and 
continuously twice differentiable in addition to being monotone increasing. Further 
they only considered the case of h(I) “ hi. Our result is also more general than 
that of Adiri and Ben-Israel [1] even though they used a general h(I). 
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III. STOCKOUT S -ALLOWED PROBLEM 



Model Formulation — The problem when stockouts are allowed in general form 
is to find u(t) ^ 0 which minimizes (3); ie, 



J (u) 



T 

[c(u(t)) + h(I(t))] dt , 

0 



where now h(I) represents holding and shortage costs. 

The Hamiltonian and in this case are the same as (5) and (14) 

du 



respectively. They are repeated here for convenience. 



H(u,I,p 0 , = p Q [c (u) + h(I) ] + p 2 [u-r] . 

dh _ _ dc (u) 
du du 



dh(I) 

dl 



dx 



The theorem stated in the previous section still provides the necessary condit- 
ions for optimal u(t). Although the assumption that — > 0 for u ^ 0 

dh 

remains reasonable, the assumption — ^ 0 is no longer reasonable over all 

possible I(t) values because the "stockouts-allowed" case can result in 

I(t) < 0. We expect instead that —— ^ 0 for I(t) < 0 because a reduct- 

di 

ion in the number of shortages should result in a decrease in stockout costs. 

It is therefore possible to get 



T dh (I) 

J t *1 



dr < 0 



and if this integral is large enough it could cause 



dH 

du 



:> 0 
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for some values of t in [0,T] . If this should happen then optimal u 
would be infinite unless we impose an upper bound on its range. We will 
therefore assume u(t) £ b < 00 . 

It is important to observe that we will always have 



dH _ _ dc (u) 

du t _ T -- du 

We can therefore say that regardless of the form of h(I) the optimal 

* 

ordering policy will always have u (T) = 0. This information will be ex- 
tremely useful in the analysis of the problem allowing stockouts. 

To progress beyond this observation, we must select a form for h(I). 
Suppose we assume a linear form as follows: 



h (I (t) ) = / 



-h^I(t) for I(t) £ 0 



h^I (t ) for I(t) ^ 0 



where h^ > 0 and h^ > 0 represent the shortage and holding costs per 



unit of inventory per unit time. When we attempt to obtain the derivative 
dh 

— of this form we realize that it does not exist at I(t) = 0. If, instead, 
we assume that h(I(t)) smoothly transitions from -h^I(t) at I(t) = -e 
to ^-h^lCt) at I(t) = + e for e > 0 but very small then the derivative 



will exist at any point in the e -neighborhood of I(t) =0. If we assume 
further that the minimum point of the h(l) curve occurs at 1=0 we can 
approximate — y by the following form: 



-h 1 for 



dh 

dl 



= < 



0 for 



h 2 for 



I(t) < 0 

I(t) = 0 

I(t) > 0 . 
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For convenience we will also assume — = k and r(t) = r where k 

du 

and r are positive constants. 

Preliminary Observations about the Optimal Policies — Under the model assumpt- 
ions we see that if I ( t ) > 0 over [0,T] then 

T 

h 2 dx = -k -h 2 [T-t] (16) 

and we realize that < 0 for all t in [0,T] . The optimal order policy 

* 

is u (t) = 0. Now if 1(0) ^ rT, we will get I(t) = l(0)-rt > 0 for 

u(t) = 0 except possibly at T where I(T) = 0 when 1(0) = rT. 

Suppose next that 1(0) < 0 and we order nothing, then I(t) = 1(0) -rt <0 
for all t in [0,T]. In this case, 




and it is possible to get 
(17) we get 



dH 

du 



= — k + h^ 



[T-t] 



5 



dH 

du 



:> 0. 



If we set 



dH 

du 



0 



and solve for 



(17) 
t in 



In the range t < t 



we have 



t = T 

dH 
du > 




0; in the range 



(18) 

t < t £ T we have 



dH 

du 



< 0 . 



Because T,k, and h^ are parameters of the problem it is possible to 

have t < 0 so that < 0 over all t in [0,T] . This will occur when 

du 

k 

T < r~ • The optimal policy when this happens is to order nothing; ie. 



u*(t) - 0. 

When T > ~ then > 0 if we order nothing. However, 

h^ du 

* 

implies that u (t) = b. If b > r then it is possible to get 



dH 

— > 

du 



0 



I(t) > 0 
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towards the end of the time period and (17) would no longer apply. Some 
form such as (19) is suggested for t in [0,t^] where t^ is the value of 
t when I(t) = 0. 



" k + h 1 [t 1 - t] - h^T-tJ . (19) 

In spite of the additional complex forms for ^ which may arise, they will 
all have an appearance similar to (19) . 



The Optimal Policies — The optimal policies for the stockouts-allowed problem 
will be stated before the arguments leading to these policies are presented. 
Before stating the optimal policies it is convenient to define several 
quantities . 

Let 



I-. = 



h 1 [r-b]t 



1 h 1 +h 2 



( 20 ) 



I 2 = [r-b] t 



( 21 ) 



I3 = rt 



( 22 ) 



t = 



[h 1 +h 2 ]l(0) - h^r-bjt 

h 1 b+h 2 r 



(23) 



where t, given by (18), is repeated here for convenience, 



C = T - h. 
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The optimal order policies are: 



1. If t > 0 

1(0) £ i 2 . 



2. If t > 0, 



3. If t > 0, 



4. If t > 0 



5 . Otherwise 



and (a) 0 < b < r, 1(0) :£ I , or 

then 



* 

u (t) 



b for 0 £ t £ t , 

0 for t < t :£ T . 



0 < b < r, and 1^ < 1(0) < I^> then 



* 

u (t) 



0 for 0 £ t < t 

b for t £ t £ t 
0 for t < t £ T 



b ^ r, and 0 ^ 1(0) £ I^> then 

' 0 for 0 S t < 
u*(t) = ( r for s£ t £ t 



0 for t < t £ T . 



, b > r, and I 



b for 

* > 

u (t) - V r for 
0 for 



< 1(0) £ 0, then 



0 :£ t £ 



- 1 ( 0 ) 

[b-r] 



- 1 ( 0 ) 

Ib-r] 



< t £ t 



t < t £ T 



* 

u (t) 



0 for all t in [0,T] 



(b) b ;> r, 
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Proof of the Optimal Policies — We have already shown that u (t) =0 if 

- k 

1(0) ^ rT or if I(t) < 0 and t < 0 (that is, T < — ) in our pre- 

h i 

liminary comments. These cases corresponded to < 0 over all t in 

[0,T]. We can add l(t) <0 and t = 0 to this list immediately because 

t = 0 corresponds to =0 at t = 0 and thus < 0 for all t in 

du du 

(0 , T] . 



Turning next to the case of I(t) £ 0 and t > 0 we realize that, 

because (17) applies, ^ > 0 for t in [0,t). In this time period 
* 

u (t) = b is the policy which will maximize H(u). The period ( t , T ] has 

dH * * * 

— < 0 in (17) and u (t) = 0. The switch from u (t) = b to u (t) = 0 

du 

takes place at t. 

The conditions necessary for maintaining I(t) £ 0 can be obtained 
from consideration of the following equation for I(t) which results 
from the optimal policy just stated. 



( 

1(0) + [b-r]t for 0 £ t £ t 



Kt) =< 



1(0) + bt - rt 



for t < t ^ T 



\ 

If b < r then l(t) decreases as t increases over [0,T] . Therefore, 
if 1(0) ^ 0 then I(t) £ 0 over [0,T] . If b = r then l(t) = 1(0) as 

long as u(t) = b and decreases as soon as u(t) = 0. 

If b > r it is possible to have I(t) > 0. Now if b > r the max- 

imum value of I(t) occurs at t. if I(t) is to be nonpositive then 
we must have 
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I(t) = 1(0) + [ b-r ] t £ 0 . 



I(t) £ 0 will occur if 

1(0) £ [r-b]t = I 2 
where < 0 because b > r. 

In summary, we have just shown that 



. , b for 0 £ t £ t , 

u’ (t) = 

0 for t < t £ T , 
for all the conditions except 0 < 1(0) £ 1-^ for 0 <b < r of the first 

optimal policy. 

For 1(0) >0 it is also possible to > 0 for some portion of [0,T] 

We will concentrate on the range 0 < 1(0) < rT because we have already 
* 

shown that u (t) = 0 for 1(0) ^ rT. If u(t) = 0 and 1(0) is in this 
range then I ( t ) < 0 for t^ < t £ T where 



t m 1 ( 0 ) 

1 r 



(24) 



The corresponding expression for is 



6H 

du 



-k -h 2 [t 1 ~t] + h^ [T— t 1 ] for 0 £ t £ ^ 



(25) 



-k +h [T-t] 



for t^ ^ t ^ T 



dH 

du 



has a slope of (+h 2 ) in the region 0 ^ t £ t^ and a slope of (-h^) 



dH 



in the region t^ £ t £ T. A representative family of curves for (25) 
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are shown in figure 1 and covers 1(0) values for [0,rT] . The curves 
designated by 1 and 5 correspond to 1(0) - 0 and 1(0) = rT, respect 
ively. The optimality condition ^ = -k for t = T is imposed on each 



curve of the figure. 

Any curve between 1 and 2 suggests one switching; that is. 



dH 

du 



is positive for t < t and negative for t > t. Any curve, such as 3 

between 2 and 4 suggests two switchings because is negative, then 

du 

positive, and then negative again. Any curve between 4 and 5 suggests 
no switching should take place. 

It is immediately evident that conditions resulting in ~~ curves 

* 

between 4 and 5 can be added to the u (t) = 0 list. Curve 4 corres 
ponds to = t which, when stated in terms of 1(0), results in 

1(0) - rt= I 3 
_ * 

Therefore, if 1(0) ^ then u (t) = 0 for all t in [0,T] . 

Because u(t) =0 is not optimal for the curves between 1 and 4 
we will first investigate the behavior of I(t) when we follow the switch- 
ing patterns suggested by the curves. We will then re-evaluate the express 
ions for ^ . This process may require several iterations before a pair 

of "matching" I(t) and ^ curves can be obtained signalling that 



optimal u(t) has been found. 

One switching should be considered for conditions creating the curves 
between 1 and 2 ; the switching should occur at = 0. From figure 1 

we know that = 0 only in the segment dominated by h^ and that (17) 

applies. Therefore switching should occur at t. 
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Figure 1. 



- — curves for equation (25) . 
du 
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If we let 



then, from (1), 



u(t) = < 



b for 0 £ t £ t , 
0 for t < t £ T , 



1(0) + [b-rjt for 0 £ t £ t , 



I(t) = 



(26) 



1(0) + bt - rt for t < t £ T 

A family of I(t) curves for (26) is shown in figure 2. Curve 1 is 

representative of a case when b > r. Curve 2 results from b = r . Curves 

3,4, and 5 correspond to b < r. Curve 5 has b = 0 and is 

the limiting curve for the b < r cases. 

Figure 3 shows the curves of corresponding to I(t) curves of 

figure 2. The same curve numbers have been used in both figures to show 

the correspondence. Curves between 1 and 3 have < 0 over [0,T] 

du 

and suggest that no switching is optimal. Curves between 3 and 5 suggest 
that at least one switching is optimal. 

For any curves between 4 and 5 we see that ^ has the same 



behavior as in figure 1 for curves between 1 and 2 

/ 

b for Q £ t £ t , 



Therefore , 



u (t) = < 



0 for t < t £ T , 
dH 



for the conditions leading to these -p- curves. 

du 



dH 



The first condition is that 0 <b < r. The second is that — ^ 0 

, du 

at t = 0. Translating this into a relationship involving 1(0) we have 



I(0) a [h i T “ kl s 
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I(t) II 



1 ( 0 ) 







Figure 2. Curves of I(t) for equation (26). 
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Figure 3. curves associated with the I(t) curves of 

a du 

figure 2. 
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This analysis has been based on the assumption that 1(0) > 0, therefore 

the proof of the first optimal policy is complete. 

We consider next the curves between 3 and 4 . Figure 2 indicates 

that 0 <b < r and figure 3 shows that two switchings may be optimal; 

the first at some time t prior to t and the second at t. The following 
policy is therefore suggested. 



u(t) = 



The corresponding expression for I(t) would then be 

/ 




Kt) = / 



1(0) - rt for 0 £ t < t 

1(0) 4- b(t-tl - rt for t £ t £ t 

1(0) + b[t-t] - rt for t < t ^ T 



(27) 



(28) 



Figure 4 illustrates the family of curves associated with (28) and 
figure 5 presents the corresponding curves. From these two figures we 

: k 

see that curves 2 and 3 will have u (t) given by (27) . To find the 

a ^ 

value of t we set ^ =0 in equation (19) where now I(t) =0 at 



t 



1 



1(0) - rt 
+ ”1 b~~r — 



We will get the expression given by (23) and t > 0 if 



Similarly, t < t if 



h [r-b] t 

1<0) > -tpnr 2 5 h 



1(0) < rt s I . 



When 1(0) - I 1 we get t = 0 and the optimal policy given by 
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Figure 4. Curves of I(t) for equation (28). 
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Figure 5. 



Curves of 



associated with the 
du 



I(t) curves 



of figure 4. 
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(27) reduces to that derived above for the case of 1(0) £ 1^ and I(t) 

A A 

corresponds to curve 4 of figure 4. If t = t then (27) reduces to 
£ 

u (t) = 0 and I(t) corresponds to curve 1 of figure 4. We have already 
* 

shown that u (t) =0 if 1(0) ^ 1^ regardless of the relationship of 

b to r. In summary, when t > 0, b < r, and 1^ < 1(0) £ I then 
* 

u (t) is given by (27) and the second optimal policy is confirmed. 

To complete the analysis of cases for 1(0) ^ 0 we next consider the 
case of b ^ r. When b = r the bound 1^ is zero while 1^ does not 
change so 0 ^ 1(0) £ 1^. Equation (23) reduces to 

; _ 1 ( 0 ) 

r 



We realize that 


t 


occurs simultaneously with t 


1 aS 


given by 


(24) 


and hence I(t) = 0 


A A ^ 

between t and t. Equation (31) shows that 


dH 

du 


is constant over this 


interval because 4^ = 0 

du 


for 


I(t) 


= 0 was 


assumed 






' -k - h 2 [t-t] + h 1 [T-t] 


for 


0 £ 


t £ t 




ii 

Ml 3 


< 


-k + h x [T-t] 


for 


t £ 


t £ t 


(31) 






, -k + h^T-t] 


for 


VI 

< 4-» 


t £ T . 





From the definition of t we also realize that this constant value of — 

du 

* 

must be zero. Therefore u (t) can take on any value between 0 and b. 
However, I(t) = 0 for t in [t,t] only if u (t) - b. 

This argument can be easily extended to the case of b > r. The optimal 
policy should take the following form, however; 

/ - 



* 

u (t) 



0 for 0 £ t < t 

/ r for t £ t £ t 

0 for t < t £ T 



(32) 



\ 
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The corresponding expression for ^ is again given by (31) and since 

dH ~ 

— = 0 over t £ t £ t we can assign any value of u as optimal between 

0 and b. The only value of u which will maintain I(t) = 0 over [t,t] 

is now u(t) = r. Figure 6 illustrates the resulting curves of I(t) and 
dH 

— . The third optimal policy has been proved. 

These arguments can also be used for the case of b > r and I < 1(0) £ 0. 

We recall that u(t) = b for [0,t] and zero outerwise would result in 
I(t) > 0. Figure 7 contains possible I(t) curves. The corresponding 
curves are shown in figure 8. 

The curves 3 in the two figures correspond to the case of 1(0) * 
and the first optimal policy applies (equation (32) would have t = Q) . 

The curves 1 and 2 from figure 7 do not allow = -k for t = T and 
hence u(t) given by (32) is not optimal. However, if we assume the following 
form for u(t) we can satisfy this condition. 



u(t) = 



for 0 £ t £ t 
for t £ t £ t 
for t £ t £ T 



(33) 



where now 



t = 



1 ( 0 ) 

[b-r] ' 



The resulting equation for ^ is: 



-k + h tt-t] + h 1 [T=t] 



dH 



ST* (- k + h i tT - tl 

-k + h, [T-t] 
J- 



for 0 £ t ^ t 
for t £ t ^ t 
for t £ t £ T 



dH ~ * 

We realize, as we did for (31), that — — = 0 for t ^ t ^ t and 

au 
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( 32 ). 
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Figure 7. Possible I(t) curves for b > r, 1(0) < 0, 

u (t) = b over [0, t] . 
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Figure 8. Curves of 



- — associated with the 
du 



curves of figure 7. 



I(t) 
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I(t) 





by (33). 
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that we should select u(t) = r to maintain I(t) = 0 over this interval. 

Therefore (33) gives the optimal policy when <1(0) £ 0. The curves of 

dH 

I(t) and are shown in figure 9. The proof of the fourth optimal policy 

is complete. 

Comments — When stockouts are allowed we see that the analysis becomes immedi- 
ately more complex because the l(t) ^ 0 constraint has been removed and 
therefore the region of feasible u(t) has expanded to always include 
u(t) = 0. The assumption of an upper bound on u and specific forms for 
the elements of the cost function appear necessary before an analysis can 
proceed. 

The linear problem presented in the preceding section was chosen for 
the illustration of the s tockouts-allowed analysis primarily because the 
cost functions are typical of many deterministic models appearing in the 
literature. Future analyses will investigate the influence of several diff- 
erent nonlinear cost forms. It should be evident from the preceding analysis 
that while the use of the Maximum Principle allows a general order policy to 
be postulated, it requires that careful consideration be given to the form 
of the objective function. In contrast to the no-stockouts model, the 
nature of the form selected will strongly influence the nature of the optimal 
order policy. 

The iterative procedure of postulating u(t), evaluating I(t) and 

, and re-postulating u(t) until finally a "matched set" of expressions 
dH 

for I(t) and — is obtained seems to hold considerable promise for 
problems having nonlinear cost functions. The virtue in obtaining the "matched 
set" is that then both the necessary and sufficient conditions for optimality 
have been obtained. 
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